Near-Optimal Sample Complexity Bounds for Maximum Likelihood Estimation of Multivariate Log-concave Densities

نویسندگان

  • Timothy Carpenter
  • Ilias Diakonikolas
  • Anastasios Sidiropoulos
  • Alistair Stewart
چکیده

We study the problem of learning multivariate log-concave densities with respect to a global loss function. We obtain the first upper bound on the sample complexity of the maximum likelihood estimator (MLE) for a log-concave density on R, for all d ≥ 4. Prior to this work, no finite sample upper bound was known for this estimator in more than 3 dimensions. In more detail, we prove that for any d ≥ 1 and > 0, given Õd((1/ )) samples drawn from an unknown log-concave density f0 on R, the MLE outputs a hypothesis h that with high probability is -close to f0, in squared Hellinger loss. A sample complexity lower bound of Ωd((1/ )) was previously known for any learning algorithm that achieves this guarantee. We thus establish that the sample complexity of the log-concave MLE is near-optimal, up to an Õ(1/ ) factor. ∗Supported by NSF Award CCF-1652862 (CAREER) and a Sloan Research Fellowship. †Supported by NSF Award CCF-1453472 (CAREER) and NSF grant CCF-1423230. ar X iv :1 80 2. 10 57 5v 1 [ m at h. ST ] 2 8 Fe b 20 18

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Nonparametric Estimation of Multivariate Convex-transformed Densities.

We study estimation of multivariate densities p of the form p(x) = h(g(x)) for x ∈ ℝ(d) and for a fixed monotone function h and an unknown convex function g. The canonical example is h(y) = e(-y) for y ∈ ℝ; in this case, the resulting class of densities [Formula: see text]is well known as the class of log-concave densities. Other functions h allow for classes of densities with heavier tails tha...

متن کامل

Global Rates of Convergence in Log-concave Density Estimation by Arlene

The estimation of a log-concave density on Rd represents a central problem in the area of nonparametric inference under shape constraints. In this paper, we study the performance of log-concave density estimators with respect to global loss functions, and adopt a minimax approach. We first show that no statistical procedure based on a sample of size n can estimate a log-concave density with res...

متن کامل

Maximum likelihood estimation of a multi- dimensional log-concave density

Let X1, . . . ,Xn be independent and identically distributed random vectors with a (Lebesgue) density f. We first prove that, with probability 1, there is a unique log-concave maximum likelihood estimator f̂n of f. The use of this estimator is attractive because, unlike kernel density estimation, the method is fully automatic, with no smoothing parameters to choose. Although the existence proof ...

متن کامل

LogConcDEAD: An R Package for Maximum Likelihood Estimation of a Multivariate Log-Concave Density

In this document we introduce the R package LogConcDEAD (Log-concave density estimation in arbitrary dimensions). Its main function is to compute the nonparametric maximum likelihood estimator of a log-concave density. Functions for plotting, sampling from the density estimate and evaluating the density estimate are provided. All of the functions available in the package are illustrated using s...

متن کامل

Active Set and EM Algorithms for Log–Concave Densities Based on Complete and Censored Data

We develop an active set algorithm for the maximum likelihood estimation of a log–concave density based on complete data. Building on this fast algorithm, we introduce an EM algorithm to treat arbitrarily censored data, e.g. right–censored or interval–censored data.

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:
  • CoRR

دوره abs/1802.10575  شماره 

صفحات  -

تاریخ انتشار 2018